Modular definition of multimodal ECA communication acts to improve dialogue robustness and depth of intention
نویسندگان
چکیده
In this paper we propose a modular structure to define communication acts with verbal and nonverbal elements inspired in the SAIBA model. Our modular structure is a conceptual interpretation of the functional features of a multimodal interaction platform we have developed, with an embodied conversational agent (ECA) that implements verbal and gestural communication strategies aimed at minimising robustness and fluency problems that are typically encountered in spoken language dialogue systems (SLDSs). We conclude that it is useful to add a pre-verbal level on top of the FML-BML scheme in the SAIBA framework, and we propose a category extension for FML to account for communication elements that have to do with the speaker’s non-declared intentions.
منابع مشابه
Langage de conversation multimodal pour agent conversationnel animé
This article falls within the realm of dialogue between a human and an Embodied Conversational Agent (ECA). We claim that a specific agent conversational language is needed for such interactions, based on the essential role of emotion in human communication. In order to define this language, we propose a library of Multimodal Conversation Acts is proposed, based in particular on speech acts and...
متن کاملA Reasoning Module to Select ECA's Communicative Intention
In the context of a ECA-human interaction, we propose to create a BDI-like reasoning engine based on the agent’s beliefs. This reasoning engine first aims to trigger the agent’s emotions from its goals, beliefs, ideals and the notion of responsibility. Then this engine selects the agent’s communicative intention from its mental states and a set of dialogue rules. The integration of “Stimulus Ev...
متن کاملModeling Lateral Communication in Holonic Multi Agent Systems
Agents, in a multi agent system, communicate with each other through the process of exchanging messages which is called dialogue. Multi agent organization is generally used to optimize agents’ communications. Holonic organization demonstrates a self-similar recursive and hierarchical structure in which each holon may include some other holons. In a holonic system, lateral communication occurs b...
متن کاملConstruction of Dialogue among couples in Yazd : Towards a Grounded Theory
Introduction: Considering the importance of Constructive communication among families; The present study has studied and explained the understanding and experience of dialogue among couples in families in Yazd. Method: In this study, a qualitative approach and grounded theory method and Purposive and theoretical sampling were used and 31 couples from normal families in Yazd were selected and ...
متن کاملExpressive Multimodal Conversational Acts for SAIBA Agents
We discuss here the need to define what we call an agent conversational language, a language for Embodied Conversational Agents (ECA) to have conversations with a human. We propose a set of Expressive Multimodal Conversation Acts (EMCA), which is based on the Expressive Speech Acts that we introduced in a previous work, enriched with the multimodal expression of the emotions linked to these act...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008